Papers with sequential decoding
Top-down Tree Structured Decoding with Syntactic Connections for Neural Machine Translation and Parsing (D18-1)
Copied to clipboard
| Challenge: | Neural machine translation (NMT) models are based on sequential decoding or serialisation of structured data into sequence. |
| Approach: | They propose a model that combines sequential encoder with tree-structured decoding augmented with a syntax-aware attention model. |
| Outcome: | The proposed model produces fluent translations with better reordering than previous models. |
Structural Reward Model: Enhancing Interpretability, Efficiency, and Scalability in Reward Modeling (2025.emnlp-industry)
Copied to clipboard
Xiaoyu Liu, Di Liang, Hongyu Shan, Peiyang Liu, Yonghao Liu, Muling Wu, Yuntao Li, Xianjie Wu, Li Miao, Jiangrong Shen, Minlong Peng
| Challenge: | Generative RMs (GRMs) lack contextual and background information during inference, leading to incomplete evaluations. |
| Approach: | They propose a modular and interpretable framework that integrates side-branch models as auxiliary feature generators. |
| Outcome: | The proposed framework outperforms scalar and saline reward models in robustness and alignment with human preferences. |
Parallel Iterative Edit Models for Local Sequence Transduction (D19-1)
Copied to clipboard
| Challenge: | Recent approaches to local sequence transduction are based on the popular encoder-decoder model for sequence to sequence learning. |
| Approach: | They propose a parallel iterative edit model for the problem of local sequence transduction arising in tasks like Grammatical error correction (GEC). |
| Outcome: | The proposed model is faster and more accurate than the current encoder-decoder model for local sequence transduction tasks like translation and paraphrasing. |
Span-Level Model for Relation Extraction (P19-1)
Copied to clipboard
| Challenge: | Recent approaches for this span-level task have inherent limitations. |
| Approach: | They propose a model which directly models all possible spans and performs joint entity mention detection and relation extraction. |
| Outcome: | The proposed model performs joint entity mention detection and relation extraction on the ACE2005 dataset. |